Replicability of Experiment

The Material Theory of Induction , now in preparation . Replicability of Experiment .

Replicability of Neural Computing Experiments

The nature of iterative learning on a randomized initial architecture, such as backpropagation training of a multilayer perceptron, is such that precise replication of a reported result is virtually impossible. The outcome is that experimental replication of reported results, a touchstone of “the scientific method,” is not an option for researchers in this most popular subfield of neural comput...

Towards Replicability in Parsing

We investigate parsing replicability across 7 languages (and 8 treebanks), showing that choices concerning the use of grammatical functions in parsing or evaluation and the influence of the rare word threshold, as well as choices in test sentences and evaluation script options have considerable and often unexpected effects on parsing accuracies. All of those choices need to be carefully documen...

Evaluating replicability of laboratory experiments in economics.

The replicability of some scientific findings has recently been called into question. To contribute data about replicability in economics, we replicated 18 studies published in the American Economic Review and the Quarterly Journal of Economics between 2011 and 2014. All of these replications followed predefined analysis plans that were made publicly available beforehand, and they all have a st...

95% Replicability for Manual Word Sense Tagging

People have been writing programs for automatic Word Sense Disambiguation (WSD) for forty years now, yet the validity of the task has remained in doubt. At a first pass, the task is simply defined: a word like bank can mean 'river bank ' or 'money bank' and the task-is to determine which of these applies in a context in which the word bank appears. The problems arise because most sense distinct...